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Pete Goldschmidt and Jose-Pelipe Martinez-Pemandez 
CRESST/University of California, Los Angeles 



Abstract 

We examine whether school quality affects passing the California High School Exit Exam 
(CAHSEE), which is a standards-based high-stakes performance assessment. We use 3-level 
hierarchical logistic and linear models to examine student probabilities of passing the 
CAHSEE to take advantage of the availability of studenf, teacher, and school level data. The 
indicators of school quality are the Academic Performance Index (API) and magnet school 
status. The results indicate that both indicators of qualify improve the probability of passing 
the CAHSEE, even after accounting for individual student characteristics. Also, the effect of 
opporfunity-to-learn increases with school quality the relationship between school quality 
and the probability of passing standards-based high-stakes performance assessments. 



Introduction 

The continuing trend of school accountability at both state and federal levels 
places increasing emphasis on identifying how well schools are performing. States with 
existing accountability systems often attempt to tie these into current No Child Left 
Behind (NCLB) legislation in order to minimize confusion at the district and school 
level. NCLB legislation has brought to the forefront that all students need to be 
proficient and that schools need to facilitate student proficiency or be subject to, among 
other things, parents being allowed to move their children to schools that can effectively 
teach students. This naturally raises the question of whether or not information 
available to parents allows them to make an informed decision when choosing where to 
place their children. California established, prior to NCLB, an academic performance 
index (API) that explicitly creates a measure of school quality. This measure is used to 
produce school rankings where schools with higher API scores are theoretically better 
than those with lower scores. Another independent indicator commonly associated with 







school quality, is whether or not a school is a magnet school/ The assumption is that 
attending a higher quality school necessarily leads to better individual performance, but 
is this, in fact, the case? Simply examining this question using the standard assessments 
given to students confounds student performance with school performance if fhe same 
tests results are used to make inferences abouf both school quality and true student 
achievement, independently. 

Using a separate assessment that is not included in the API school quality index, 
and is based on different standards, can shed some light on the role of school quality 
and how school quality might impact student achievement. Given that accountability 
no longer applies solely to schools, but to students as well, students have a vested 
interested in attending schools that will facilitate attainment of higher levels of 
achievement. For the particular case of fhis paper we are interested in the effect of 
school quality on the probability of passing the California High School Exit Exam 
(CAHSEE). 

Under the over-arching question of what the relationship between school quality 
and the probability of passing standards-based high-stakes performance assessments is, 
we examine the following four issues: a) How much of fhe variation in CAHSEE scores 
is actually attributable to schools? Only that portion of fhe variation in CAHSEE scores 
that varies among schools can actually be accounted for by differences in school quality, 
b) Eor the average student, does school quality affect the probability of passing the high 
school exit exam? c) If fhe mechanism fhrough which schools facilitate learning is 
through opportunity to learn, are there differences in how opportunities to learn 
translate into student performance between high and low quality schools? d) Are all 
students equally impacted by school quality? 

Background 

The API and the CAHSEE are two central components in the State's recent 
accountability-based efforts towards improvement in school effectiveness and student 
achievement.^ The Academic Performance Index measures "fhe academic performance 
and growfh of schools... A school's score on fhe 2001 API is an indicator of fhe school's 

' Schools are not designated magnet schools based on API scores but usually exist due to the efforts of 
groups of teachers and parents. There is a general perception that magnet schools are higher quality than 
common schools as evidenced by the fact that parents usually need to undertake an extensive process in 
order to apply for their child to be admitted into a magnet school. There is a subset of magnet schools 
where student performance is a condition of acceptance, but for these the magnet's quality designation 
would not be wholly independent of fhe API. 

^ Both are either primary (assessments used to generate API scores are also used in NCLB) or secondary 
annual measurable objectives (AMOs) included in Adequate Yearly Progress (AYP) calculations. 
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performance level/' (California Department of Education, 2003a). The API is also used 
to set goals for improvement that schools should meet every year as part of the state's 
accountability system. The calculations for the API include scores on the Stanford 
Achievement Test Version 9 (SAT-9) and the California Standards Tests. Although the 
API is intended to monitor school performance and present easily interpretable 
information to parents and education policy-makers, the use of unadjusted mean test 
scores^ presents misleading results (Aitkin & Longford, 1986; Goldstein & Meyers, 
1996). Also, ranking schools on the basis of means artificially attributes all of the 
variation in achievement to differences among schools (Raudenbush & Bryk, 2002), 
over-emphasizes the importance of student background characteristics because these 
characteristics are aggregated (Hanushek, 1986), and in general inadequately describes 
which differences in the index are actually statistically significant (Goldstein, 1997). 
Further, measures of school quality may not adequately capture other dimensions of 
school quality, especially processes occurring within schools (Baker, Goldschmidt, 
Martinez-Fernandez, & Swigert, 2002). Despite these limitations, this is the current 
measure of school quality to which parents have ready access. 

The CAHSEE is intended to "significantly improve pupil achievement in public 
high schools and to ensure that pupils who graduate from public high schools can 
demonstrate grade level competency in reading, writing, and mathematics" (California 
Department of Education, 2003b). The test consists of extensive multiple choice and 
open-ended sections that are aligned to state performance standards. It was initially 
offered in 2001 and is planned to become a mandatory requirement for graduation in 
the 2005-2006 school year. Two key elements of the 2001 CAHSEE for the purpose of 
our study are that the results of this test were not yet included in the API calculations 
for that year — as mentioned before, after 2002 the CAHSEE is part of the API. 
Additionally, the CAHSEE matches standards thought important for high school 
graduates to meet, rather than the grade matched skills assessed by the SAT-9. 

Hence, SAT-9 results summarize the current status of performance and how well 
students' performance compares to what students should have had an opportunity to 
learn up to 10*^ grade.'^ The CAHSEE, taken before the final year of high school, assesses 
how students are making progress towards passing fixed standards-based criteria. In 
general, SAT-9 results, summarized by the APP, measure how well students know (or 
how well schools get students to know) what they ought to know in 10*^ grade, and this 

^ The API is a weighted mean — weighted by student subgroups and content areas. 

9* grade for 20% of our sample. 

® Five for each high school, of course, the API summarizes school performance based on 9*, 10*, and 11* 
grade sfudent SAT-9 assessment results. 
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should in theory bear some relationship to how well students are progressing towards a 
final absolute criterion — the CAHSEE. The issue of interest in this study is whether 
school quality impacts the chances of a studenf passing the CAHSEE. 

Given that students can only be held accountable for whaf they have had, an 
opportunity to learn (OTL) (Burstein & Winters, 1994), schools should be held 
accountable for both providing that opportunity and for ensuring that those 
opportunities produce the expected educational benefits. The effect of OTL is a more 
concrefe mechanism through which we can examine the effects of school qualify, 
beyond simply comparing mean performance differences between high and low quality 
schools. 



Data and Methods 

The data are from a large, racially integrafed, urban school district in California 
and consist of approximately 45,000 mainly 10*^ grade students attending more than 200 
schools (a small number of 9* graders were included in the 2001 sample). Descriptive 
statistics for the sample are presented in Table 1. The outcome measure of interest is the 
CAHSEE that, in the 2001-2002 school year, was not included in the California 
accountability system API computations. We have additional student test scores that 
include reading and mathematics SAT-9 scores. However, as noted, SAT-9 scores were 
two of the primary factors used in calculating schools' API scores, and for this reason 
we exclude these from the analysis. Additionally, student demographic information is 
available that allows us to adjust for enrollment factors typically considered outside the 
direct control of the school (e.g., gender, ethnicity, language proficiency^ socioeconomic 
status, gifted and special education status). The days attended variable is used as a 
rough measure of opportunity to learn and represents the number of days attended for 
the fall semester. 

The dataset also allows for the inclusion of variables that describe the educational 
context, both at the classroom and school levels of aggregation. The classroom dataset 
includes information on teacher qualifications and experience, as well as class size, 
mean achievement levels, and other aggregates of student enrollment. Another 
important aspect of school quality included is whether or not the student is attending a 
classroom that is a magnet school classroom. At the school level we are mostly 
interested in the API index and its relationship to the probability of passing the 

While it appears that this sample does not adequately represent English language learner (ELL) 
students, it is important to note that by 9* or 10* grade, the majority of ELL students will have been 
redesignated. 







CAHSEE. Additional information is also available about the schools, including school 
size, aggregates of the socioeconomic characteristics of the students' families, and 
whether or not the school hosts a magnet school. 

As we noted above, another indicator of perceived school quality is whether or not 
a school is a magnet school. Many magnet schools in this district are part of a host 
school. In fact, 42% of schools host a magnet school on their campus. Still, this only 
represents 10% of the students. Given that magnet schools are actually schools within 
schools, we code students as attending either the magnet school or the host non-magnet 
at the classroom level. This coupled with the fact that magnet schools do not receive 
separate API scores from fheir host schools, allows us to examine the effects of two 
different quality measures separately. This also allows us to examine whether there are 
any externalities accruing to non-magnet school students attending the host school. 
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Table 1 

Sample Descriptive Statistics 



Statistics 

Students (n=28,801) 

% Pass CAHSEE Language Arts 53% 

Mean Score CAHSEE Language Arts 354.16 

% Pass CAHSEE Mathematics 31% 

Mean Score CAHSEE Mathematics 337.75 

10* Grade 80% 

9* Grade 20% 

Female 51% 

ELL 18% 

RFEP (Redesignated fully English proficient) 43% 

Special Education 3% 

Low SES (Free Meal) 61% 

Magnet 10% 

Days Attended 77 

Ethnicity 

American Indian 1% 

Asian 5% 

African American 11% 

Hispanic 67% 

White 13% 

Other 3% 

Classroom / Teacher (n=811) 

Class size 36.02 

Table 1 {continued) 
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Statistics 


Magnet Classroom (School) 


8% 


Teaching Experience 


Less than 3 


69% 


3 to 10 Years 


16% 


More than 10 


15% 


Teacher Education 


5 or Less Years 


75% 


6 to 10 


17% 


11 or More 


8% 


School (n=43) 


Size (10* Grade, Incl. Magnet) 


717.7 


API 


557.58 


Average Parental Education 


2.45 


Hosts a Magnet School 


42% 



Methodology 

The sample consists of a nested structure including data at the student, class, and 
school levels. Ignoring the multiple levels in the data can lead to substantive errors in 
inferences regarding estimated effects of variables at different levels (Burstein, 1980). 
The outcome of interest is dichotomous (passing the CAHSEE or not) so the method 
employed is a three-level multilevel logistic regression (Raudenbush & Bryk, 2002). In 
this model, the probability of the event, E, occurring for a student, conditional on the 
student's characteristics, is placed on a logarithmic odds ratio scale so that the model is 
defined as: 

In [P( pijk)/(l- P( pijk)] = po^ + pij*a lij^+ ...+ p„yjt Cl„ijk (1) 



when the log odds of passing the CAHSEE for student i, in classroom j, in school k are a 
function of the school mean probability of passing {poj^) adjusted for effects (p 2 y;t---P«/i) of 
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student characteristics {a^^. This is convenient to work with because, it is simply a 
linear sum of the explanatory variables. Equation 1 (the Level-1 or student model) is 
expanded to include classroom (Level-2) and school (Level-3) components: 



Level-2 (Classroom) Model 



Pojk — hook + boik ^Ijk + ■ • ■ + bomk ^mjk + I'ojk (2) 

The classroom's mean probability of passing fhe CAHSEE (pojk) after controlling for 
sfudent level characferistics, is represented as a function of a mean classroom effect for 
a school, (book) plus the effect (boik- • -bomk) of independent classroom-level variables (Xs), 
and a component of random error (rojk). The random effect (rojk) captures the variables in 
mean passing rates among classrooms. Similarly, for fhe student level effects: 



Pnljk = b„0k + b 



nlk ^Ijk + 



+ b 



nmk ■'^mjk 



+ r, 



njk 



(3) 



The classroom mean student effect (e.g., the mean classroom effect of gender) (p ^ijk) 
affer controlling for student characteristics is represented as a function of a mean effecf 
for a school (b„ok) plus fhe effect (bnik---bnmk) of classroom variables (Xs) and a random 
error ferm (r^j,^). The random effects (r^j,^) capture the variation in student effects among 
classrooms. Lor example, it may be that girls have a different probability of passing the 
CAHSEE and that this difference varies significanfly from classroom to classroom. 



Level-3 (School) Model 

book — goOO goOl l^lk + ■ • ■ + goop ^^nk + Ugpk (4) 

where the mean CAHSEE passing rate for a school, adjusted for student and classroom 
characteristics, is a function of a grand mean passing rate for all schools (gooo) the effect 
(gooi....goop) of school specific characterisfics (fhe W's), and a random error component 
(uopk). Unlike ordinary least squares regression coefficients (or single level logistic 
models), in multilevel models the parameters are subscripted by j and k, indicating that 
each classroom and school can have a different intercept and slope(s). The Level-1 and 
Level-2 coefficients can be specified as being either fixed, non-randomly varying, or 
randomly varying (Raudenbush & Bryk, 2002). A model wifh several sfudent-level 
explanatory variables can have any combination of fhe fhree specifications. 



10 




The pass /no pass decision is based on an underlying score on the CAHSEE. We 
take advantage of having these scores available to counter the modeling limitations 
imposed by the logistic specification. In three-level data structures such as the one 
employed in this study, the number of additional parameters estimated grows very 
quickly as more predictors are added into the model, and this along with the increased 
computational needs of non-linear models soon overburdens fhe data. In particular, 
estimation of fhe variance components becomes infeasible for most or all of fhe sfudent 
and classroom-level parameter slopes. In other words, we are not able to take full 
advantage of fhe random effects and cannot model how classroom and school context 
might affect student correlates of performance. As expected, estimation of fhe multilevel 
logistic models presented above became troublesome as more predictors were added. 
Only equation (1) needs to be altered in order to simplify the logistic model into a 
continuous model. Hence, for fhe confinuous outcome Y, we use the following student 
(Level 1) model: 

Yijk = Pojk + Pijk*aiijk + ■ • ■+ Pnjk*anijk+ 6ijk, where e ~N(0,s^). 

Yijk is the CAHSEE score for student i in classroom j in school k. The ps are 
modeled as above (Equations 2-4). Using the continuous three level model also allows 
us to parse the variation into all three levels. The advantage is that we can directly 
estimate the extent to which CAHSEE scores' variation can be attributed to students, 
classrooms, and schools. 



Results 

The complete results for a fhree-level model tend to be complex, so we present 
results, building one level at a time. Hence, we begin with a completely random model 
without any predictors and subsequently examine the effects of sfudent, classroom, and 
school variables sequentially. 

The variance components in Table 2 reveal significant and considerable variation 
in the probabilities of passing fhe language and mafhematics exams arising from 
classroom differences wifhin schools. The results, in fact, suggest that between- 
classroom variability is at least as, or more important, than that observed between 
schools (Level-3). This provides support for one of fhe basic tenets of fhis study, namely 
that classroom attendance inside a school is a key determinant of performance on fhe 
CAHSEE, or student performance in general. 



11 




Table 2 



Three-Level Multilevel Logistic Model — Unconditional Model Results 







CAHSEE Language 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f. 


approx, p 


Baseline 


GOOO 


-0.31 


0.15 


-2.05 


42 


0.05 


Random Effect 




Standard 

Deviation 


Variance 


c2 






Classroom 


RO 


1.39 


1.93 


1815.93 


775 


0.00 


School 


UOO 


0.88 


0.78 


241.68 


42 


0.00 






CAHSEE Mathematics 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f. 


approx, p 


Baseline 


GOOO 


-1.35 


0.14 


-9.88 


42 


0.00 


Random Effect 




Standard 

Deviation 


Variance 


c2 






Classroom 


RO 


1.16 


1.35 


1492.31 


775 


0.00 


School 


UOO 


0.81 


0.65 


239.35 


42 


0.00 



The intercept presented in Table 2 can be interpreted as the unconditionab or base- 
line, log-odds, of passing the CAHSEE. The results indicate that the average expected 
log-odds of passing fhe CAHSEE for the students in the sample are -0.307 for Language, 
and -1.34 for Mathemafics. Alfhough it is mathematically convenient for modeling 
binary data, the log-odd scale is more intuitively interpretable if transformed to the 
familiar 0 to 1 scale for fhe probability of an event. The average probability of passing is 
given by fhe expression: exp(G000)/[l-i- (GOOO)], which for Language Arts is {exp(- 
0.307) / [1-1- exp(-0.307)]} = 0.42 indicating that less than half of the students in the sample 
pass the Language Arts exit exam. In Mathematics, the average probability of passing is 
considerably lower at (exp(-1.346)/[l-i- exp(-1.346)][ = 0.21. 

Table 3 presents the estimated parameters for the effects of student background 
characteristics on the probability of passing fhe CAHSEEs — parameters excluded from 
fhe table were not significant in the model. By centering the student predictors around 
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their grand means, the intercepts in these models represent the log-odds of passing for 
fhe average student in the sample. The probability that an average student attending a 
typical school passes the CAHSEE in Language Arts can be obtained as {exp(-0.047)/ [l-i- 
exp(-0.047)]} = 0.48. Similarly, the probability of passing the Math CAHSEE for fhe 
average sfudent is {exp(-1.35)/[l-i- exp(-1.35)]} = 0.21. Note that these probabilities are 
adjusted for student characteristics and school environment, and therefore can be 
slighfly different from fhe raw descriptive statistics presented in Tables 1 and 2 above. 



Table 3 

Three-Level Multilevel Logistic Model — Effect of Sfudenf Characteristics in Probability of 
Passing 

Effects of Covariates 
CAHSEE CAHSEE 





Language Arts 


Mathematics 


Intercept (yqoo) 


-0.047 


-1.35. 


Days Attended (OTL) (yjoq) 


0.013 


0.02 


ELL (y 2 oo) 


-2.40 


-1.60 


RFEP (ysoo) 


-0.32 


-0.26 


Ethnicity 

American Indian (y 4 oo) 






Asian (ysoo) 


- 


0.61 


African American (ysoo) 


- 1.20 


-1.39 


Hispanic (Y 700 ) 


-0.50 


- 0.86 


Ofher (ysoo) 


-0.42 


-0.47 


Special Education (Y 900 ) 


-3.03 


-3.15 


Low SES (yiooo) 


- 0.21 


-0.16 


Gender (yhoo) 


0.36 


-0.61 


Grade (yizoo) 


1.00 


1.13 



Note. (1) all covariables in this table with values are significant at p < .05. 

The parameter estimates for fhe covariafes represent the difference, in terms of log 
odds of passing, from fhe average student as represented by the intercept. Thus for 
example, fhe log odds of passing for Hispanic students are, on average, 0.50 lower in 



13 




Language Arts, and 0.86 lower in Math. Other things being equal, Hispanic students 
have on average a {exp(-0.047-0.50)/[l+ exp(-0. 047-0. 50)]} = 0.36 probability of passing 
the Language Arts CAHSEE. In other words, a Hispanic student who has the same 
background characteristics as an average student has an excepted probability of passing 
fhe CAHSEE that is 12 percentage points lower than the average student. It is important 
to note that this accounts for fhe potential effects of being an ELL student. Similarly, 
Hispanic students have only a {exp(-1.35-0.86)/[l-i- exp(-1.35-0.86)]| = 0.10 probability of 
passing the Math CAHSEE on their first try, 11 percentage points less than the average. 
The results for fhe student covariates are consistent with expectations. 

A rough first cut indication for OTL is grade, as students in higher grades have 
more opportunities to learn the content required for graduation. We would expect 10*^ 
grade students to have a greater probability of passing than 9*^ grade students. In the 
model, grade level was recoded as a binary variable in such a way that Grade 9 was 
assigned a 0, and Grade 10, a 1. The grade parameter in the model therefore represents 
the expected advantage in the log-odds of passing for students in the 10*^ grade. The 
results show 10*^ graders have, on average, a {exp(-0.047-i-1.00)/ [l-i- exp(- 
0.047-1-1.00)] }=0. 72 probability of passing fhe Language Arts CAHSEE, and a {exp(- 
1.35-1-1.13)/ [1-1- exp(-l. 35-1-1. 13)]} = 0.44 probability of passing fhe Mafh CAHSEE. A 
second, more refined indicator of OTL is fhe number of days attended. The results 
displayed in Table 3 indicate that there is a statistically significant effect for atfendance. 
In fact, there is a 10 percentage point difference in fhe chances of passing fhe CAHSEE 
(results are approximately the same for language arts and mathematics) between high 
attending and low attending students^. That is, among students in the same grade, 
students attending class more regularly have greater chances of passing fhe CAHSEE. 

We nexf turn to our first indicator of school quality, magnet school status. As 
noted, we code magnet attendance at the classroom level because magnet schools are 
generally located within a host school and do not receive a separate API. The results in 
Table 4 present the unadjusted effects associated with attendance in a magnet 
classroom. The parameter estimates for magnets represent an advantage in terms of 
probability of passing for students attending magnet schools, other things being equal. 
On average, the log odds of passing fhe exam for students attending magnet schools are 
1.29 higher in Language Arts, and 1.61 higher in Math. In terms of probabilities, these 
effects translate to a (exp(-0.30-i-1.21)/[l-i- exp(-0. 30-1-1. 21)]} =0.71 probability of passing 



^ We consider students to be high attendees if they attend school one or more standard deviations above 
average. We consider students low attendees if they attend one or more standard deviations below 
average. 
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the Language Arts CAHSEE, (a 0.29 advantage), and {exp(-1.31+1.61)/ [1+ exp(- 
1.31+1.61)]} = 0.57 probability of passing the Math CAHSEE (a 0.36 advantage). 



Table 4 



Three-Level Multilevel Logistic Model — Magnet Schools Predictors 







CAttSEE Language 






Fixed Effect 




Estimate 


Standard 

Error T-ratio 


d.f 


approx p 


Baseline 


GOOD 


-0.31 


0.15 -2.03 


42 


0.05 


MAGNET 


GOlO 


1.29 


0.24 5.30 


816 


0.00 






CAHSEE Mathematics 






Fixed Effect 




Estimate 


Standard 

Error T-ratio 


d.f 


approx p 


Baseline 


GOOD 


-1.31 


0.14 -9.43 


42 


0.00 


MAGNET 


GOlO 


1.61 


0.36 4.51 


42 


0.00 



By way of comparison, we also briefly examine fhe unadjusted effect of school 
quality, as measured by the API. These results are displayed in Table 5. The API 
parameter estimates represent the increase in probability of passing, per 100 point 
increase on the 800-point API scale, holding all other factors constant. As an example, 
we take a hypothetical school with an API score 100 points higher than another school. 
The log odds of passing the exam for students attending the school with the higher API 
are 0.94 higher in Language Arts, and 0.89 higher in Math. This translates to a {exp(- 
0.26+0.94) /[1+ exp(-0.26+0.94)]} =0.66 probability of passing fhe Language Arts 
CAHSEE, a 23 percentage point advantage between the two. Eor Mathematics, the 
probability is {exp(-1.28+0.89)/ [1+ exp(-l. 28+0.89)]} = 0.40, a 19 percentage point 
advantage. 

We next examine the combined effects of bofh of the school quality indicators, 
magnet status and API. These results are displayed in Table 6. The results indicate that 
students who attend schools with higher API's have a higher probability of passing fhe 
Language Arts and Mathematics Exit Exams, even after taking into account whether 
they attend magnet classrooms. The log odds of passing for a student in a school with 
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an API 100 points higher than another are on average 0.93 higher in Language Arts, and 
0.86 higher in Math, even after taking Magnet schools into account. 

The results indicate that the effect of magnet schools remains considerable. On 
average, students who attend magnet classrooms have an advantage in their probability 
of passing the CAHSEEs, even if they attend host schools with similar APIs. 
Interestingly, the API of the host school does not have an effect on the advantage of 
magnet classrooms operating within it, as indicated by a statistically insignificant You 
parameter. In other words, students attending a school that does not host a magnet 
school benefit from school quality as measured by the API; students who attend a 
school hosting magnet school also benefit from school quality as measured by the API, 
but to a lesser extent (the parameter estimates in Table 4 for the API effect on the mean 
probabilities are larger than the parameter estimates for API effect on the mean 
probabilities in Table 5). While the marginal effect of each API point is lower for these 
students, a host school is likely to have slightly higher API due to hosting a magnet, 
than it otherwise would if it did not host a magnet. Students attending magnet 
classrooms do not derive any additional benefit from the magnet class's host school 
being of better quality. 



Table 5 

Three-Level Multilevel Logistic Model — API Schools as Predictors 







CAFtSEE Language 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f 


approx p 


Baseline 


GOOD 


-B.27 


B.B8 


-3.33 


41 


B.BB 


APfOl 


GOBI 


B.Bl 


B.BB 


9.94 


41 


B.BB 






CAFtSEE Mathematics 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f 


approx p 


Baseline 


GOOD 


-F.28 


B.B5 


-24.94 


41 


B.BB 


APIOl 


GOBI 


B.Bl 


B.BB 


14.41 


41 


B.BB 



Pinally we combine all of the student, class, and school characteristics into a single 
three-level logistic model. Due to limitations noted above, all variables displayed in 
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Table 1 are not included in this analysis, but will be used subsequently in the 
continuous outcome models. 



Table 6 

Three-Level Multilevel Logistic Model — Magnet Schools and API as Predictors 







CAHSEE Language 






Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f 


approx p 


Baseline 


GOOO 


-0.30 


0.08 


-3.66 


41 


0.00 


APIOl, 


GOOl 


0.01 


0.00 


9.65 


41 


0.00 


Magnet, 


GOlO 


1.33 


0.39 


3.46 


41 


0.00 


APIOl, 


GOll 


0.00 


0.00 


0.38 


41 


0.71 






CAHSEE Mathematics 






Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f 


approx p 


Intercept, 


GOOO 


-1.30 


0.05 


-24.61 


41 


0.00 


APIOl, 


GOOl 


0.01 


0.00 


13.72 


41 


0.00 


Magnet, 


GOlO 


0.84 


0.18 


4.72 


816 


0.00 


APIOl, 


GOll 


0.00 


0.00 


1.54 


816 


0.12 



The results in Tables 7 and 8 display the effects of fhe school quality indicators, 
controlling for fhe student covariates. That is, accounting for differences in student 
enrollment, does school quality have an effect on the probability of passing the 
CAHSEE? Although differences in student enrollment can account for some of fhe 
befween-school variation in the probability of passing fhe CAHSEE, fhe marginal effects 
of magnet school status and the API remain statistically significant and positive. The 
major exception is that once student enrollment and school quality are taken into 
account, magnet school students no longer have a higher probability of passing fhe 
Mafh CAHSEE. 

Anofher way fo understand the effects of fhe API and magnet school status is 
presented in Pigure 1. Eigure 1 presents the probability of passing fhe Language Arts 
CAHSEE for different levels of school quality as measured by the API, as well as for 
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magnet and non-magnet school students. Figure 2 presents the results for the 
Mathematics CAHSEE. There is only one line displayed because magnets and non- 
magnet students have equal chances of passing the Mathematics CAFiSEE, ceteris 
paribus. 

Table 7 

Summary of Multilevel Logistic Model Results Language Arts CAHSEE (standard error in 
parentheses) 





Model 0 


Model 1 


Model 2 


Model 3 




(ANOVA) 


(Student 

Covariates) 


(Magnet 
and API) 


(Slopes as 
outcomes. 
Fixed) 


Intercept 


-0.307 


-0.080 


-0.299 


-0.300 


Fixed effects 




0.02 

(0.00) 




0.02 

(0.00) 


Days Attended (OTL) (yjoq) 






ELL (y2oo) 




-2.44 

(0.07) 




-2.38 

(0.07) 


KEEP (y3oo) 




-0.30 

(0.04) 




-0.29 

(0.04) 


Ethnicity 










American Indian (y 4 oo) 
Asian (ysqo) 




- 




0.34 

(0.11) 


African American (ysoo) 




-1.27 

(0.08) 




-1.05 

(0.08) 


Hispanic (y 7 oo) 




-0.60 

(0.06) 




-0.39 

(0.06) 


Ofher (ysoo) 




-0.38 

(0.12) 




- 


Special Education (y 9 oq) 




-2.99 

(0.33) 




-2.65 

(0.38) 


Low SES (yiooo) 




-0.16 

(0.04) 




-0.16 

(0.04) 


Gender (yhoo) 




0.42 

(0.03) 




0.43 

(0.03) 


Magnet 






1.33 

(0.38) 


0.74 

(0.17) 


API (100 Points) 






0.93 

(0.00) 


0.6 

(0.00) 



Note. Only Significant parameters (p < .05) are presented. 



18 




Table 8 

Summary of Multilevel Logistic Model Results (Mathematics CAHSEE) 





Model 0 


Model 1 


Model 2 


Model 3 




(ANOVA) 


(Student 

Covariates) 


(Magnet 
and API) 


(Slopes as 
outcomes. 
Fixed) 


Intercept 


-1.31 


-1.34 


-1.29 


-1.48 


Fixed effects 










Days Attended (OTL) (yjqo) 




0.03 

( 0 . 00 ) 




0.03 

( 0 . 00 ) 


ELL (y 2 oo) 




-1.37 

(0.08) 




-1.62 

(0.08) 


KEEP (y 3 oo) 




-0.24 

(0.04) 




-0.24 

(0.04) 


Ethnicity 










American Indian (y 4 oo) 




-0.58 

(0.29) 




- 


Asian (y^o) 




0.60 

(0.09) 




0.86 

( 0 . 10 ) 


African American (y 6 oo) 




-1.45 

(0.07) 




-1.30 

(0.09) 


Hispanic (Y 700 ) 




-0.94 

(0.05) 




-0.74 

(0.06) 


Ofher (ysoo) 




-0.46 

( 0 . 10 ) 




- 


Special Education (Y 900 ) 




-3.12 

(0.46) 




- 


Low SES (yiooo) 




- 0.12 

(0.04) 




-0.09 

(0.04) 


Gender (yhoo) 




-0.53 

(0.03) 




0.54 

(0.03) 


Magnet 






0.83 

(0.17) 


- 


API (100 Points) 






0.86 

( 0 . 00 ) 


0.80 

( 0 . 00 ) 



Note. Only significant parameters (p < .05) are presented. 
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100.09^ 




API = 200API = 250API = 30O\PI = 350API = 400API = 450API = 500API = 550API = 60CAPI = 650API = 600API = 750API = 800API = 85CAPI = 900API = 950 API = 

1000 



APi score 



Figure 1. Probability of passing the Language Arts CAHSEE. 




200 250 300 350 400 450 500 550 600 650 600 750 800 850 900 950 1000 

APi Score 



Non Magnet— — Magnet 



Figure 2. Probability of passing the Mathematics CAHSEE. 



Turning to the role of OTL and school quality, we present Figures 3 through 6. 
Figures 3 and 5 compare the effect of attendance on the probability of passing the 
CASHEE. Eor Language Arts, there are increasing probabilities of passing the CAHSEE 
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as attendance increases, and these probabilities increase further with school quality. 
This is also the case for mafhemafics, excepf fo a larger exfenf. The exfenf fo which 
differences in affendance maffer by levels of school qualify is displayed in Figures 4 and 
6. Generally, for bofh Language Arfs and Mafhemafics, fhe difference in fhe probabilify 
of passing befween sfudenfs wifh high and low affendance rafes increases wifh school 
qualify. Thaf is, OTL has a more beneficial effecf on passing fhe CAHSEE in beffer 
qualify schools. 




- API = 350 API = 450 API = 550 API = 650 API = 750 



Figure 3. Probability of passing the Language Arts CAHSEE. 
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API = 550 
School quality 



■ Passing rate for Student with low Attendance ■ Difference in passing rate due to attendance being high 



Figure 4. Marginal effect of OTL on passing rates by school quality - English Language 
Arts 

CAHSEE. 




API = 350 API = 450 API = 550 API = 650 API = 750 



Eigure 5. Probability of passing the Mathematics CAFiSEE. 
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60.0% 



^ 50.0% 




API = 350 



API = 450 



API = 550 

School quality 



API = 650 



API = 750 



I Passing rate for Student with low Attendance ■ Difference in passing rate due to attendance being high 



Figure 6. Marginal effect of OTL on passing rates by school quality - Mathematics CASHEE. 



Continuous Model 

The ANOVA unconditional models are presented first for reference and 
comparison to subsequent models. These models allow estimation of the proportion of 
variance at each of the three levels in the model — which is not possible with a logistic 
model. The results for both Language Arts and Mathematics, presented in Table 9 , 
indicate most of the variability lies between the students within classrooms and schools 
(47.5% Language Arts and 58.5% Mathematics). At the second and third levels, the 
results reflect the same patterns observed in the logistic models, with a large classroom 
variance component, and a considerably smaller but still sizeable school component. 

The results confirm that placing too much emphasis on differences between 
schools to account for differences in achievement is misleading. Variation among 
classrooms represents a larger portion of the variation in scores. For example, the mean 
Language Arts CAHSEE score in a classroom is about 345, but we would expect this to 
vary (95% Cl) between 301 and 389. Given that we can parse the variation in CAHSEE 
scores into the appropriate level of aggregation in the model, we can examine whether 
magnet schools bring additional heterogeneity into schools. These results are displayed 
in Table 10. As expected, there is much greater variation attributable to classrooms in 
schools hosting magnet schools than to classrooms in schools not hosting magnet 
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schools. Still the within-classroom variation is relatively similar between the two school 
types. 

Table 9 

Three-Level Multilevel Linear Model — Unconditional Model Results 







CAFtSEE Language 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 


d.f 


approx p 


Baseline 


GOOD 


345.16 


2.44 


141.31 


42 


0.00 


Random Effect 




Standard 

Deviation 


Variance 


c2 


d.f 


approx p 


School 


UOO 


14.65 


214.50 


15.90 


42 


0.00 


Classroom 


RO 


22.19 


492.52 


36.50 


775 


0.00 


Student 


E 


25.29 


639.43 


47.50 










CAHSEE Mathematics 








Fixed Effect 




Estimate 


Standard 

Error 


T-ratio 




approx p 


Baseline 


GOOD 


331.53 


1.90 


174.79 


42 


0.00 


Random Effect 




Standard 

Deviation 


Variance 


c2 


d.f 


approx p 


School 


UOO 


11.22 


125.92 


11.50 


42 


0.00 


Classroom 


RO 


18.05 


325.88 


29.90 


775 


0.00 


Student 


E 


25.25 


637.44 


58.50 
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Table 10 



Three-Level Unconditional Linear Model — Summary of Variance Components in Magnet and Non- 
magnet Schools 



Random Effect 


Variance Components (%) 

Overall Magnet Non-magnet 

Schools 


Reading 


Schools, (UOO) 


214.5 (15.9) 


92.01 (6.46) 


301.0 (20.6) 


Classrooms, (RO) 


492.5 (35.5) 


667.8 (46.9) 


522.3 (35.8) 


Students, (E) 


639.4 (47.5) 


663.7 (46.6) 


632.2 (43.4) 


Math 


Schools, (UOO) 


125.9 (11.5) 


78.39 (6.59) 


157.7 (15.5) 


Classrooms, (RO) 


325.8 (29.9) 


436.0 (36.6) 


280.6 (27.6) 


Students, (E) 


637.4 (58.5) 


674.1 (56.7) 


576.0 (56.7) 



Including student covariates at the student level explains about 13% of the 
student-level variance in the Language Arts CAHSEE and about 11% of fhe variance in 
Mafhematics. The values of the fixed coefficients for the student covariates are 
presented in the Appendix. In general, the student level results based on a continuous 
outcome are not substantively different from fhose presented earlier for fhe logistic 
models. The student covariates have effects consistent with the literature; including 
large disadvantages for African American and Hispanic sfudents, as well as English 
learners and special education students. Eemale students perform better than their male 
counterparts in Language, while the opposite is true in Mathematics. As before, OTL 
has a significant impact on the chances of passing both exit exams. 

The results displayed in Tables 11 and 12 summarize the cross-level interaction 
effects of classrooms and schools on both the mean CAHSEE scores and specific sfudent 
covariate effects. That is, we can determine whether school quality has a direct impact 
on specific performance gaps. The first step in determining whether student covariates 
might be affected by classroom or school contexts is to determine the extent to which 
the parameter estimates vary among both classrooms and schools. The results in Tables 
A1 and A2 indicate that each of the estimated parameters for all of the student 
background characteristics vary significantly among classrooms, within schools. Eor 
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example, the average performance gap between ELL and non-ELL students on the 
Language Arts CAHSEE (Model 4 in Table Al) is -17 points. This performance gap 
between ELL and non-ELL varies among classrooms, however. In fact, comparing 
classrooms where this performance gap is one standard deviation above average with a 
classroom where it is one standard deviation below average demonstrates that these 
classrooms differ by about 14.6 points in the gap (-17-i-7.3-(-17-.7.3) = 7.3-I-7.3 =14.6). 

The effectiveness of OTL varies significantly among classrooms as well. The 
difference, calculated as above, in the effect of OTL is .46 points per day attended. This 
translates into about a 9-point difference at the end of fhe semester between a high and 
low attending student. Given the substantively and statistically significant variation in 
student level effects, we next examine whether class or school context can account for 
any of fhis variation. The context variables we focus on, of course, are fhe school quality 
indicators. 

Consistent with the logistic models, the effect of school quality (both magnet and 
API) exerts considerable positive influence on fhe likelihood fhat students will pass the 
exit exams, even after taking student background characteristics into account. 
However, these school indicators have only minimal impact on the student level effects. 
The results are presented in Tables 11 and 12. The results in Table 11, pertaining to 
Language Arts, indicate that the benefit of attending magnet schools accrues to all 
students equally. That is, a student attending a magnet school is expected to score about 
13.5 points higher, ceteris paribus. But the Language Arts achievement gaps that exist 
are not diminished in magnet classrooms. The results in Table 11 indicate that school 
quality, as measured by the API, does not improve student performance equally. Lor 
example, a non-ELL student is expected to score about 18 points better if he attends a 
high quality school.*^ In contrast, there is only a 5.6 ((8.9-6.09)x2) point benefit accruing 
to ELL students. This means that although an ELL student benefits from attending a 
higher quality school, the gap between non-ELL and ELL probabilities of passing fhe 
CAHSEE increases. 

The results indicate that OTL generates a greater benefit in magnet schools. On 
average, each day attended in a magnet classroom translates into a 0.22 point gain more 
per day than in a non-magnet classroom. There is no additional direct effect due to the 
API. Pigure 7 displays this result graphically. The figure highlights that a student with 



* We define a high quality school as one that has an API 1 standard deviation above average and a low 
quality school one that has an API 1 standard deviation below average. The standard deviation for the 
API is about 100 points. 
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low attendance attending a magnet school is expected to out-perform a student with 
high attendance not attending a magnet classroom. 

Table 11 

Summary of Level-2 and Level-3 Effects (Language Arts CAHSEE-Model 4) 

Classroom Predictors School Predictors 





Magnet 


Class 

Size 


Teacher 
Ed. (6-10) 


Teacher 
Ed. (10-I-) 


Average 
Parent Ed. 


API 

(100 Pts) 


Intercepf 


13.54 

(2.44) 


0.11 

(0.01) 


- 


6.63 

(2.61) 


- 


8.9 

(0.02) 



Level-1 Parameter 



Days Attended (OTL) (yjoq) 0.22 

( 0 . 10 ) 

ELL(y2oo) ■ -6.09 

( 0 . 02 ) 

KEEP (y3oo) - -3.32 

(0.01) 

American Indian (y 4 oo) 

Asian (ysoq) - -5.45 

( 0 . 02 ) 

African American (ysoo) 

Hispanic (y 7 oo) 

Other (ysoo) 

Special Education (y 9 oq) 

Low SES (yiooo) 

Gender (yhoo) 

The effects for Mathematics are presented in Table 12 and are generally the same 
as for Language Arts, except for fhe role of school quality on OTL. As with Language 
Arts, each day of attendance generates additional performance benefits above those 
accruing to non-magnet students. However, school quality, as measured by the API also 
has a direct effect on OTL. That is, on the Mathematics CAHSEE students attending 
higher quality schools benefit more in terms of improved performance for each day 
attended than students attending low quality schools. 
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The results in Figure 8 are similar to those in Figure 7, except that high-attendance 
students in non-magnet classrooms are expected to outperform low-attendance 
students in magnet classrooms. This occurs as a result of fhe direcf impacf school 
qualify has on fhe effecf of affendance. Thaf is, general school qualify can mifigafe fhe 
effecf of nof being a magnef school sfudenf when fhe school hosfs a magnef school. 




Non Magnet - low Att. 

— Non Magnet - Ave. Att. 
Non Magnet - High Att. 

Magnet - Low Att. 

— — Magnet - Ave. Att. 

— — Magnet - High Att. 



School Quality 



Figure 7. Effect of school quality on the benefit of OTL - Language Arts. 
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Table 12 

Summary of Level-2 and Level-3 Effects (Mathematics CAHSEE — Model 4) 







Classroom Predictors 




School Predictors 




Magnet 


Class Teacher 

Size Ed. (6-10) 


Teacher 
Ed. (10-I-) 


Average API 

Parent Ed. 


Intercept 


10.10 

(1.98) 


0.07 

(0.01) 


- 


8.4 

(0.01) 


Level-1 Parameter 










Days Attended (OTL) (yjoq) 


0.34 

(0.11) 






0.08 

(0.00) 


ELL (y2oo) 


-7.45 

(2.9) 






-5.94 

(0.01) 


RFEP (ysoo) 


■ 






■ 


American Indian (y 4 oo) 


“ 






“ 


Asian (ysqo) 


- 






- 


African American (ysoo) 


-4.27 

(2.00) 






“ 


Hispanic (y 7 oo) 


■ 






■ 


Other (ysoo) 


- 






- 


Special Education (y 9 oo) 


-13.42 

(6.46) 






- 


Low SES (yiooo) 


-5.53 

(1.44) 






- 


Gender (yhoo) 


- 






-2.40 

(0.00) 
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443 



425 

408 



390 

373 

355 

338 

320 

303 




Non Magnet - low Att. 

Non Magnet - Ave. Att 

Non Magnet - High Att 

Magnet - Low Att. 
Magnet - Ave. Att. 
Magnet - High Att. 



285 



268 



250 ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ 1 

API = API = API = API = API = API = API = API = API = API = API = API = API = API = API = API = API = 
200 250 300 350 400 450 500 550 600 650 600 750 800 850 900 950 1000 



School Quality 



Figure 8. Effect of school quality on the benefit of OTL - Mathematics. 



Discussion 

Within the current climate of accountability — both student and school, it is 
increasingly important to identify whether available information regarding schools can 
lead to beneficial decisions by parenfs for their children. If sfudenfs are to be held 
accountable for passing a standards-based performance assessment, then schools need 
to be held accountable for enabling sfudents fo pass such an exam. But holding schools 
accountable necessarily implies that schools vary in the success with which they can 
facilitate student progress towards successfully completing the high school exit exam 

The evidence demonstrates that schools do, indeed, vary in terms of the passing 
rates of their students, but that a greater amount of the variation in passing rates is 
attributable to classrooms and students within classrooms than to schools. This means 
that policy aimed at alleviating differences among schools (whether measured in this 
analysis or not), will only marginally impact differences in sfudenf passing rates. 
However, school quality as measured by the API does increase the mean passing rates 
of studenfs in a school. This means thaf if schools are failing sfudents, then parents can 
use the API to choose a high school that will provide a better opportunity to pass the 
exit exam. Unfortunately, school quality is not synonymous with egalitarianism. While 
all students benefit from attending a better quality school some traditionally 
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disadvantaged students, such as ELL, REEL, and girls (in the case of mathematics), do 
not benefit as much as their classmates which results in larger performance gaps 
befween groups. 

School quality information is also conveyed by whether or not a student attends a 
magnet school (or magnet classroom within a school). Magnet school students are 
expected to perform better, and this benefit is independent of fhe host school's quality. 
Eurther, there is a positive externality accruing to students attending a school that hosts 
a magnet school, even if fhat student is not attending a magnet classroom. 

An important aspect of school qualify fhaf needs to be considered is the logical 
extent to which school processes affect student outcomes — in this case it is how well 
schools can translate OTL into performance gains. We would naturally expect higher 
quality schools to be so, precisely because they can more effectively translate OTL into 
performance gains. But if the school quality index we used merely represents an 
aggregate of student quality, then school quality would have no effect on OTL. In fact, 
the evidence indicates that school quality does impact how effectively schools translate 
opportunities to learn into performance success. 

The results also highlight the extent to which classrooms, and by extension 
teachers, play a role in student achievement gains — more variation exists between- 
classrooms within schools than between schools suggesting that educational 
experiences in the classroom are the most important determinant for student academic 
performance (and, consequently, success in the CAHSEE). However, more research is 
warranted with more classroom specific confext variables, teacher characteristics 
variables, and specific measures of OTL. 
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APPENDIX 



Student level results of three-level continuous models 
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Table A1 



Summary of Multilevel Linear Model Results (Language Arts CAHSEE) 





Model 0 


Model 1 


Model 2 


Model 3 


Model 4 




(ANOVA) 


(Student 

Covariates) 


(Magnet 
and API) 


(Slopes as 
outcomes. 
Fixed) 


(Slopes as 
outcomes. 
Random) 


Intercept 


345.15 


348.57 


345.51 


348.01 


348.03 


Fixed effects 












Days Attended (OTL) (yioo) 




0.29 

(0.02) 




0.29 

(0.01) 


0.28 

(0.01) 


ELL (Y200) 




-27.7 

(0.80) 




-27.0 

(0.66) 


-27.99 

(0.79) 


KEEP (y 3 oo) 




-5.38 




-5.45 


-5.33 




(0.44) 




(0.45) 


(0.46) 


Ethnicity 












American Indian (7400) 




- 




- 


- 


Asian 




- 




4.62 

(1.05) 


3.64 

(1.12) 


African American (Ysoo) 




-16.54 

(1.03) 




-16.7 

(0.90) 


-15.45 

(1.23) 


Hispanic (y^o) 




-7.54 

(0.95) 




-7.26 

(0.65) 


-6.64 

(0.98) 


Other (ysoo) 




-5.09 

(1.14) 




- 


- 


Special Education (Y900) 




-28.09 

(1.41) 




-22.3 

(1.83) 


-24.66 

(1.51) 


Low SES (yiooo) 




-2.40 

(0.66) 




-2.62 

(0.41) 


-2.37 

(0.53) 


Gender (y„oo) 




5.76 

(0.31) 




5.95 

(0.32) 


5.85 

(0.32) 


Magnet 






20.3 


13.5 


17.9 


Table A1 {continued) 






(3.34) 


(2.44) 


(4.08) 


API (100 Points) 






14.9 


8.80 


8.9 








(1.49) 


(0.02) 


(0.02)) 


Random effects (Std Dev) 
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Model 0 
(ANOVA) 



Model 1 

(Student 

Covariates) 



Model 2 

(Magnet 
and API) 



Model 3 

(Slopes as 
outcomes. 
Fixed) 



Model 4 

(Slopes as 
outcomes. 
Random) 



Classrooms 



Days Attended (OTL) (Rioo) 


0.18 


ELL (R 200 ) 


8.88 


African American (R^oo) 


7.55 


Hispanic (R 700 ) 


5.21 


Special Education (R 900 ) 


7.36 


Low SES (Riooo) 


1.65 


Schools 




Days Attended (OTL) (Rioo) 


- 


ELL (R 200 ) 


- 


African American (R^oo) 


- 


Hispanic (R 700 ) 


3.74 


Special Education (Rjoo) 


- 


Low SES (Riooo) 


3.24 







3.45 



1.93 



Model Fit 

Deviance 213577 209466 213477 209650 209318 

Note. Only Significant parameters (p <.05) are presented 








Table A2 



Summary of Multilevel Linear Model Results (Mathematics CAHSEE) 





Model 0 


Model 1 


Model 2 


Model 3 


Model 4 




(ANOVA) 


(Student 

Covariates) 


(Magnet 
and API) 


(Slopes as 
outcomes. 
Fixed) 


(Slopes as 
outcomes. 
Random) 


Intercept 


331.5 


332.7 


332.0 


332.75 


331.98 


Fixed effects 












Days Attended (OTL) (yjoo) 




0.33 

( 0 . 02 ) 




0.29 

( 0 . 01 ) 


0.35 

( 0 . 02 ) 


ELL (Y 200 ) 




-16.9 

(0.71) 




-16.3 

( 0 . 66 ) 


-17.1 

(0.72) 


RFEP (y3oo) 




-2.23 




-2.64 


-2.41 




(0.44) 




(0.45) 


(0.46) 


Ethnicity 












American Indian (Y 400 ) 




■ 




■ 


■ 


Asian 




9.05 

( 0 . 86 ) 




12.6 

(1.05) 


10.5 

(1.13) 


African American (Ysoo) 




-18.69 

(1.18) 




-19.0 

(0.90) 


-17.4 

(1.29) 


Hispanic (y^oo) 




- 11.11 

( 1 . 02 ) 




-10.73 

(0.65) 


-9.61 

( 1 . 01 ) 


Other (ysoo) 




-5.87 

(1.15) 




- 


- 


Special Education (ysoo) 




-21.91 

(1.38) 




-19.3 

(1.77) 


-18.8 

(1.49) 


Low SES (yiooo) 




- 




-1.16 

(0.41) 


- 


Gender (yhoo) 




-6.28 

(0.31) 




-6.40 

(0.32) 


-6.47 

(0.32) 


Magnet 






14.6 


12.8 


10.7 








(2.57) 


(2.23) 


(1.98) 


API (100 Points) 






12.1 


8.81 


8.08 








(0.09) 


( 0 . 01 ) 


( 0 . 01 ) 



Random effects (Std Dev) 
Classrooms 



Days Attended (OTL) (Rioo) 
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Table A2 (continued) 





Model 0 


Model 1 


Model 2 


Model 3 


Model 4 




(ANOVA) 


(Student 

Covariates) 


(Magnet 
and API) 


(Slopes as 
outcomes. 
Fixed) 


(Slopes as 
outcomes. 
Random) 


ELL (R 200 ) 




7.24 


■ 


■ 


7.32 


African American (R^oo) 




9.64 






9.64 


Hispanic (R 700 ) 




7.44 






7.38 


Special Education (R 900 ) 




6.04 






- 


Low SES (Riooo) 




2.47 






2.12 


Schools 












Days Attended (OTL) (Rioo) 




- 






- 


ELL (R 200 ) 




■ 






■ 


African American (R^oo) 




- 






- 


Hispanic (R 700 ) 




3.91 






3.14 


Special Education (Rjoo) 




" 






■ 


Low SES (Riooo) 




2.46 






1.99 


Model Fit 












Deviance 


213226 


209313 


213103 


209608 


208635 



Note. Only Significant parameters (p <.05) are presented 
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